MatFormer architecture

Papers

Matryoshka Representation Learning “Our main contribution is Matryoshka Representation Learning (MRL) which encodes information at different granul…”
트랜스포머 아키텍쳐의 오리진 스토리 관련 절: Chapter 9. The Goliath Paradox
Nested Learning: The Illusion of Deep Learning Architectures “Over the last decades, developing more powerful neural architectures and simultaneously designing optimization …”
Attention is all you need “We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing…”
BioGPT “In this paper, we propose BioGPT, a domain-specific generative Transformer language model pre-trained on large-…”
GPT의 오리진 스토리 관련 절: Chapter 10. Size Matters
Distributed Representation (paper) “The thesis closes by considering two broad kinds of reasons for supposing distribution to be the form of mental…”
Connectionist approaches to language “These theories assume an underlying symbolic COGNITIVE ARCHITECTURE based in Discrete mathematics, the theory o…”
Text-to-LoRA: Instant Transformer Adaption 주제어가 겹침
Attention is Turing Complete 주제어가 겹침